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(54) Apparatus and method for controlling the shift of the viewpoint in a virtual space 



(57) A virtual-space shift control apparatus includes 
a detecting element that detects a touch operation or a 
drag operation of a pointing device having a plurality of 
pointing elements, performed on a display screen and 
a viewpoint-position information generator that gener- 
ates viewpoint position information of a virtual space im- 



age based on the detected touch or drag operation of 
the detecting element. A three-dimensional image gen- 
erator is provided that generates data on the virtual 
space image seen from a viewpoint indicated by the 
viewpoint position information and outputting a three di- 
mensional image to the display. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an apparatus 
for controlling the shift of a virtual space and a method 
and a program for controlling the same. More particu- 
larly, the present invention relates to an apparatus for 
generating virtual space shift information required for 
virtual space shift image processing and controlling the 
shift of a computer graphics (CG) model when the user 
shifts the virtual space image displayed on a computer 
terminal and a method and a program for controlling the 
same. 

Description of the Related Art 

[0002] Virtual spaces sometimes called cyberspaces 
used in virtual reality and expressed with CG are con- 
ventionally known. The user can sense information 
while moving in a virtual space displayed on a computer 
terminal. Common man-machine interfaces for moving 
in the virtual space on the computer terminal include 
mice, joysticks and so on. 

[0003] The mice are used to convert a shift operation 
over a virtual space display area with a cursor into shift 
information in the space in accordance with the opera- 
tion. The joysticks are used to convert the direction and 
the angle of the inclination of the stick into shift informa- 
tion in the space. However, the mice and the joysticks 
which are conventional interfaces are difficult for users 
who have not use computers to get a sense of perform- 
ing shift operation in a virtual space. 
[0004] Man-machine interfaces for performing similar 
operations as the mice and the joysticks also include 
touch panels, which allow the change of a display by 
directly pointing a shifted position in the virtual space 
with a finger or the like. However, with general touch 
panels, a shift operation in a virtual space similar to that 
with the mice or the joysticks cannot be performed with 
only a finger, which requires another operation, thus 
leading to troublesome operation and avoiding an intu- 
itive operation. 

SUMMARY OF THE INVENTION 

[0005] The present invention has been made in con- 
sideration of such problems and accordingly, it is an ad- 
vantage of the present invention to provide an apparatus 
for controlling a shift in virtual space which allows the 
user to perform various virtual space shift operations by 
a simple operation with a finger or the like, and a method 
and a program for controlling the same. 
[0006] The present invention has been made to solve 
the above problems. According to an aspect of the in- 
vention, a virtual-space shift control apparatus is provid- 



ed for shifting a virtual space image displayed on a dis- 
play screen of a display, the apparatus comprising in- 
cludes a detecting element for detecting a touch opera- 
tion or a drag operation of a pointing device having a 

5 plurality of pointing parts, which is performed on the dis- 
play screen and a viewpoint-position information gener- 
ator for generating viewpoint position information of the 
virtual space image on the basis of the detection of the 
detecting element. The apparatus also includes a three- 

10 dimensional image generator for generating data on a 
virtual space image seen from a viewpoint indicated by 
the viewpoint position information and outputting it to the 
display. 

[0007] According to another aspect of the invention, 
'5 a virtual-space shift control apparatus includes an oper- 
ation detecting element for detecting the number of 
pointing parts of a pointing device and the respective 
touch positions of the plurality of pointing parts, the 
pointing device performing a touch operation or a drag 
20 operation on a prescribed display area on which a virtual 
space image is displayed and an information control 
section for generating viewpoint shift information for 
shifting the viewpoint on the virtual space image on the 
basis of the number of the pointing parts and the respec- 
ts tive touch positions of the pointing parts and outputting 
it to the display. The apparatus also includes a display 
for displaying the virtual space on the basis of the shift 
information outputted from the information control sec- 
tion. 

30 [0008] According to the invention, preferably, the in- 
formation control section generates viewpoint shift in- 
formation for shifting the position of the viewpoint to the 
touch position on the basis of the position of the touch 
operation by one of the plurality of pointing parts. 

35 [0009] According to the invention, preferably, the in- 
formation control, section receives time-series data on 
the distance and the direction from the starting point to 
the end point of the drag operation by one of the plurality 
of pointing parts and generates viewpoint shift informa- 

40 tion for shifting the viewpoint on the basis of the time- 
series data on the distance and the direction from the 
starting point toward the end point. 
[001 0] According to the invention, preferably, the dis- 
play displays a virtual plane formed of a two-dimension- 

45 al space image and a virtual space formed of a three- 
dimensional virtual space image at the same time; and 
a viewpoint icon for the virtual space, which is displayed 
in the virtual plane, receives time-series data on the dis- 
tance and the direction from the starting point to the end 

so point of the drag operation by one of the plurality of point- 
ing parts, and the information control section generates 
viewpoint shift information for shifting the viewpoint in 
the virtual space on the basis of the time-series data on 

^ the distance and the direction from the starting point to 

55 the end point of the drag operation. 

[001 1 ] According to the invention, preferably, the dis- 
play displays a virtual plane formed of a two-dimension- 
al space image and a virtual space formed of a three- 
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dimensional virtual space image at the same time; and 
a viewing angle icon for the viewpoint in the virtual 
space, which is displayed in the virtual plane, receives 
data on a turning angle of the drag operation by one of 
the plurality of pointing parts, and the information control 
section generates viewpoint shift information for turning 
the viewing angle by the turning angle. 
[0012] According to the invention, preferably, the in- 
formation control section receives data on the distance 
and the direction from the first touch position of the initial 
touch operation to the second touch position of the next 
touch operation, and generates viewpoint shift informa- 
tion for shifting the viewpoint on the basis of the distance 
and the direction from the first touch position to the sec- 
ond touch position. 

[0013] According to the invention, preferably, the in- 
formation control section determines the position of a 
split point at which the line connecting the first touch po- 
sition and the second touch position in a designated pro- 
portion on the basis of the first touch position and the 
second touch position, and generates viewpoint shift in- 
formation for changing the speed or the acceleration at 
which the viewpoint is shifted, on the basis of the time- 
series changes of the position of the split point. 
[0014] According to the invention, preferably, the dis- 
play displays a virtual plane formed of a two-dimension- 
al space image and a virtual space formed of a three- 
dimensional virtual space image at the same time; and 
the information control section receives time-series data 
on the distance between the touch positions by two of 
the plurality of pointing parts, and generates scale infor- 
mation for enlarging or reducing the virtual plane on the 
basis of the time-series changes of the distance be- 
tween the touch positions by the two pointing parts. 
[0015] According to the invention, preferably, the in- 
formation control section receives time-series data on 
the position of the central point of the first to n* touch 
positions, and generates viewpoint shift information for 
shifting the viewpoint on the basis of the time-series 
changes of the position of the central point of the first to 
n** 1 touch positions. 

[0016] According to the invention, preferably, the dis- 
play displays an operation icon for operating the view- 
point in the virtual space; and the information control 
section receives time-series data on the distance and 
the direction from the starting point to the end point of 
the drag operation of a drag section of the operation 
icon, and generates viewpoint shift information for shift- 
ing the viewpoint on the basis of the time-series changes 
of the distance and the direction from the starting point 
to the end point. 

[0017] According to yet another aspect of the inven- 
tion, a virtual-space shift control system is provided for 
shifting a virtual space image displayed on a display 
screen, includes the processes of detecting a touch op- 
eration or a drag operation of a pointing device having 
a plurality of pointing parts, which is performed on the 
display screen; generating viewpoint position informa- 



tion of the virtual space image on the basis of the detec- 
tion of the detecting element; and generating a three- 
dimensional image for generating data on a virtual 
space image seen from a viewpoint indicated by the 
s viewpoint position information and outputting it to the 
display. 

[0018] According to another aspect of the invention, 
a virtual-space shift control system is provided for shift- 
ing a virtual space image displayed on a display screen, 

10 wherein the operation detecting element detects the 
number of pointing parts of a pointing device and the 
respective touch positions of the plurality of pointing 
parts, the pointing device performing a touch operation 
or a drag operation on a prescribed display area on 

15 which a virtual space image is displayed; the information 
control section generates viewpoint shift information for 
shifting the viewpoint on the virtual space image on the 
basis of the number of the pointing parts and the respec- 
tive touch positions of the pointing parts, and outputs it 

20 to the display; and the display displays the virtual space 
on the basis of the shift information outputted from the 
information control section. 

[0019] According to the invention, preferably, the in- 
formation control section generates viewpoint shift in- 

25 formation for shifting the position of the viewpoint to the 
touch position, on the basis of the position of the touch 
operation by one of the plurality of pointing parts. 
[0020] According to the invention, preferably, the in- 
formation control section receives time-series data on 

30 the distance and the direction from the starting point to 
the end point of the drag operation by one of the plurality 
of pointing parts, and generates viewpoint shift informa- 
tion for shifting the viewpoint in the virtual space on the 
basis of the time-series data on the distance and the 

35 direction from the starting point to the end point. 

[0021] According to the invention, preferably, the dis- 
play displays a virtual plane formed of a two-dimension- 
al space image and a virtual space formed of a three- 
dimensional virtual space image at the same time; and 

40 a viewpoint icon for the virtual space, which is displayed 
in the virtual plane, receives time-series data on the dis- 
tance and the direction from the starting point to the end 
point of the drag operation by one of the plurality of point- 
ing parts, and the information control section generates 

45 viewpoint shift information for shifting the viewpoint in 
the virtual space on the basis of the time-series data on 
the distance and the direction from the starting point to 
the end point of the drag operation. 
[0022] According to the invention, preferably, the dis- 

50 play displays a virtual plane formed of a two-dimension- 
al space image and a virtual space formed of a three- 
dimensional virtual space image at the same time; and 
a viewing angle icon for the viewpoint in the virtual 
space, which is displayed in the virtual plane, receives 

55 data on the turning angle of the drag operation by one 
of the plurality of pointing parts, and the information con- 
trol section' generates viewpoint shift information for 
turning the viewing angle by the turning angle. 
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[0023] According to the invention, preferably, the in- 
formation control section receives data on the distance 
and the direction from the first touch position of the initial 
touch operation to the second touch position of the next 
touch operation, and generates viewpoint shift informa- 
tion for shifting the viewpoint on the basis of the distance 
and the direction from the first touch position to the sec- 
ond touch position. 

[0024] According to the invention, preferably, the in- 
formation control section determines the position of a 
split point at which the line connecting the first touch po- 
sition and the second touch position is split in a desig- 
nated proportion on the basis of the first touch position 
and the second touch position, and generates viewpoint 
shift information for changing the speed or the acceler- 
ation at which the viewpoint is shifted, on the basis of 
the time-series changes of the position of the split point. 
[0025] According to the invention, preferably, the dis- 
play displays a virtual plane formed of a two-dimension- 
al space image and a virtual space formed of a three- 
dimensional virtual space image at the same time; and 
the information control section receives time-series data 
on the distance between the touch positions by two of 
the plurality of pointing parts, and generates scale infor- 
mation for enlarging or reducing the virtual plane on the 
basis of the time-series data on the distance between 
the touch positions by the two pointing parts. 
[0026] According to the invention, preferably, the in- 
formation control section receives time-series data on 
the position of the central point of the first to n 4 * 1 touch 
positions, and generates viewpoint shift information for 
shifting the viewpoint on the basis of the time-series 
changes of the position of the central point of the first to 
n lh touch positions. 

[0027] According to the invention, preferably, the dis- 
play further displays an operation icon for operating the 
viewpoint in the virtual space; and the information con- 
trol section receives time-series data on the distance 
and the direction from the starting point to the end point 
of the drag operation of a drag section of the operation 
icon, and generates viewpoint shift information for shift- 
ing the viewpoint on the basis of the time-series changes 
of the distance and the direction from the starting point 
to the end point. 

[0028] According to another aspect of the invention, 
a program is provided for use in a virtual-space shift con- 
trol apparatus for shifting a virtual space image dis- 
played on a display screen of a display, the apparatus 
includes a detecting element for detecting a touch op- 
eration or a drag operation of a pointing device having 
a plurality of pointing parts, which is performed on the 
display screen; a viewpoint-position information gener- 
ator for generating viewpoint position information of the 
virtual space image on the basis of the detection of the 
detecting element; and a three-dimensional image gen- 
erator for generating data on a virtual space image seen 
from a viewpoint indicated by the viewpoint position in- 
formation and outputting it to the display. 



[0029] According to another aspect of the invention, 
a program is provided for executing a virtual-space shift 
control apparatus includes an operation detecting ele- 
ment for detecting the number of pointing parts of a 

5 pointing device and the respective touch positions of the 
plurality of pointing parts, the pointing device performing 
a touch operation or a drag operation on a prescribed 
display area on which a virtual space image is displayed; 
an information control section for generating viewpoint 

10 shift information for shifting the viewpoint on the virtual 
space image on the basis of the number of the pointing 
parts and the respective touch positions of the pointing 
parts, and outputting it to the display; and a display for 
displaying the virtual space on the basis of the shift in- 

15 formation outputtedfrom the information control section. 
[0030] According to another aspect of the invention, 
a recording medium is provided in which a program for 
executing a virtual-space shift control apparatus for 
shifting a virtual space image displayed on a display 

20 screen of a display is recorded, the apparatus includes 
a detecting element for detecting a touch operation or a 
drag operation of a pointing device having a plurality of 
pointing parts, which is performed on the display screen; 
a viewpoint-position information generator for generat- 
es jng viewpoint position information of the virtual space 
image on the basis of the detection of the detecting el- 
ement; and a three-dimensional image generator for 
generating data on a virtual space image seen from a 
viewpoint indicated by the viewpoint position informa- 

30 ton and outputting it the display. 

[0031] According to another aspect of the invention, 
a recording medium is provided in which a program for 
executing a virtual-space shift control apparatus is re- 
corded, the apparatus includes an operation detecting 

35 element for detecting the number of pointing parts of a 
pointing device and the respective touch positions of the 
plurality of pointing parts, the pointing device performing 
a touch operation or a drag operation on a prescribed 
display area on which a virtual space image is displayed; 

40 an information control section for generating viewpoint 
shift information for shifting the viewpoint on the virtual 
space image on the basis of the number of the pointing 
parts and the respective touch positions of the pointing 
parts and outputting it to the display; and a display for 

45 displaying the virtual space on the basis of the shift in- 
formation outputted from the information control section. 

BRIEF DESCRIPTION OF THE DRAWINGS 

so [0032] Fig. 1 is a schematic diagram of a virtual-space 
shift control apparatus according to an embodiment of 
the present invention. 

[0033] Fig. 2 is a general view of a two-dimensional 
virtual plane and a three-dimensional virtual space of a 
55 city displayed on a screen. 

[0034] Fig. 3 is a flowchart of a process in an informa- 
tion control section 3 when a touch operation or a drag 
operation is performed in a two-dimensional plane. 
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[0035] Fig. 4 is a flowchart of a process in the infor- 
mation control section 3 when a touch operation or a 
drag operation is performed in a three-dimensional 
space. 

[0036] Fig. 5 is a diagram of a control screen for 
searching a building in neighborhoods. 
[0037] Fig. 6 is a diagram of an example of the image 
of the external appearance of a condominium in which 
the virtual-space shift control apparatus is used for a re- 
al-estate brokerage system. 

[0038] Fig. 7 is a diagram showing the appearance of 
room No. 1 ,806 on the 1 8 th floor of the condominium of 
Fig. 6. 

[0039] Fig. 8 is a diagram showing the interior of the 
room of the condominium of Fig. 7. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0040] An embodiment of the present invention will be 
described with reference to the drawings hereinafter. 
Fig. 1 is a schematic diagram of a virtual-space shift con- 
trol apparatus according to the embodiment. A display 
1 displays a virtual space image generated by a CG 
model. When a prescribed display area of the display 1 
is touched or dragged by a pointing device having a plu- 
rality of pointing elements such as fingers, operation de- 
tecting elements 2 sense the number of pointing ele- 
ments of the touch operation or the drag operation and 
the respective touch positions of the pointing elements. 
An information control section 3 generates viewpoint 
shift information for moving the viewpoint in the display 
of the virtual space in accordance with the sensed 
number of pointing elements and the sensed touch po- 
sitions- of the pointing elements and outputs it to the 
display. 

[0041 ] The operation of the virtual-space shift control 
apparatus according to an embodiment of the present 
invention will then be described. 
[0042] The operation detecting elements 2 are mount- 
ed on the left and right of the display 1 , as shown in Fig. 
1 , and scans the surface of the display 1 at a high speed 
at regular intervals by an optical coordinate measuring 
method. When a touch operation or a drag operation is 
performed on the display with the pointing elements, the 
operation detecting element 2 senses the number and 
the direction of the pointing elements that block scan- 
ning light by the blockage of the light. The information 
control section 3 receives the detection of the direction 
of the pointing elements that block the light by the dif- 
ferent operation detecting elements and calculates ac- 
curate pointing position coordinates on the principle of 
trigonometrical survey. The information control section 
3 then determines the distances among the pointing el- 
ements on the basis of the calculated position coordi- 
nates of the pointing elements. 
[0043] The information control section 3 generates 
viewpoint shift information for shifting the viewpoint on 
a virtual space display on the basis of the respective 



position coordinates of the pointing elements and the 
distances among the pointing elements and outputs it 
to the display 1 . The display 1 displays a virtual space 
image on the basis of the shift information outputted 
s from the information control section 3. 

[0044] As described above, the arrangement of the 
embodiment permits the generation of shift information 
to a CG model displayed in a virtual space, the shift in- 
formation being for shifting the viewpoint in the virtual 
space display on the basis of the touch operation or the 
drag operation of a pointing device having a plurality of 
pointing elements in a prescribed area, and allows the 
shift information to be incorporated to the CG model. 
[0045] A specific processing procedure of the virtual- 
space shift control apparatus according to an embodi- 
ment of the present invention will now be described. Fig. 
2 is a general view of a two-dimensional virtual plane 
and a three-dimensional virtual space of a city displayed 
on the display 1 of Fig. 1 . A city map is displayed in the 
two-dimensional virtual plane, on which a viewpoint dis- 
play icon indicating a viewpoint in the three-dimensional 
virtual space is displayed. The viewpoint display icon 
has a viewpoint icon 4, which indicates the position co- 
ordinates of the viewpoint and serves as the center of 
the turn of the icon, and a viewing angle icon 5 which 
indicates the viewing angle in the three-dimensional vir- 
tual space. 

[0046] The two-dimensional virtual plane and the 
three-dimensional virtual space are displayed on the 
same position coordinates, wherein when the viewpoint 
is moved, the shifts thereof are displayed in synchroni- 
zation with each other. The three-dimensional virtual 
space is displayed by a coordinate value that indicates 
the height and by a rolling angle, a heading angle, a pitch 
angle, and an angle of view that specify the direction of 
the viewpoint. 

[0047] The information control section 3 determines 
how many fingers are used for operation by the user, 
which of a touch operation and a drag operation was 
performed, and at which display area and to which ob- 
ject the operation was performed, and generates shift 
information including the position coordinates, the ver- 
tical coordinate, and the change of the rolling angle, the 
heading angle, the pitch angle, and the angel of view. A 
description of the specific individual process will be de- 
scribed hereinafter. 

[0048] When the virtual-space shift control apparatus 
is activated, the information control section 3 displays 
an address input screen and the display 1 displays a 
viewpoint display icon on an area map that is a two-di- 
mensional virtual plane image and in the position of an 
inputted address on the basis of the address inputted 
by the user. A three-dimensional virtual space image 
viewed from the position of the viewpoint display icon is 
then displayed. 

[0049] Subsequently, a specific operation will be de- 
scribed when the operation detecting element 2 has de- 
tected that a touch operation or a drag operation was 
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performed on the display with pointing elements. 
[0050] The case in which the touch operation or the 
drag operation is performed in the two-dimensional vir- 
tual plane will first be described with reference to the 
flowchart of the process in the information control sec- 
tion 3 of Fig. 3. 

(1) Viewpoint Shift Operation by Touch Operation 

[0051] When the user performs a touch operation on 
the city map in the two-dimensional virtual plane with a 
finger (one in step Sa1 , the object of search is a map in 
step Sa2, and a touch operation in step Sa3), the oper- 
ation detecting element 2 detects the touch position and 
outputs it to the information control section 3. The infor- 
mation control section 3 shifts the position of the view- 
point to the touch position by the detection of the touch 
position, generates viewpoint shift information for shift- 
ing the viewpoint, and outputs it to the display 1 . The 
display 1 displays a two-dimensional virtual plane in 
which the viewpoint display icon on the city map is shift- 
ed and a three-dimensional virtual space image which 
is seen from a shifted viewpoint (refer to step S1). 

(2) MAP SHIFT OPERATION BY DRAG OPERATION 

[0052] When the user performs a drag operation on 
the city map in the two-dimensional virtual plane with a 
finger (one in step Sa1 , the object of search is a map in 
step Sa2, and a drag operation in step Sa3), the oper- 
ation detecting element 2 detects the distance and the 
direction from the starting point to the end point of the 
drag operation in time sequence and outputs them to 
the information control section 3. The information con- 
trol section 3 generates viewpoint shift information for 
shifting the map from the starting point toward the end 
point of the drag operation by a distance from the start- 
ing point to the end point on the basis of the detection 
of the distance and the direction from the starting point 
to the end point, and outputs it to the display 1 . The dis- 
play 1 displays a two-dimensional virtual plane in which 
the map was shifted by a distance traveled by the drag 
operation on the basis of the viewpoint shift information 
outputted from the information control section 3 (refer to 
step S2). 

(3) VIEWPOINT SHIFT OPERATION BY DRAG 
OPERATION 

[0053] When the user performs a drag operation on a 
viewpoint icon 4 displayed on the city map in the two- 
dimensional virtual plane with a finger (one in step Sa1 
and the object of search is a viewpoint icon in step Sa2), 
the operation detecting element 2 detects the distance 
and the direction from the starting point to the end point 
of the drag operation in time sequence and outputs them 
to the information control section 3. The information con- 
trol section 3 generates viewpoint shift information for 



shifting the viewpoint display icon and the viewpoint in 
the three-dimensional virtual space to the end point of 
the drag operation on the basis of the distance and the 
direction from the starting point to the end point, and 
5 outputs it to the display 1 . The display 1 displays a two- 
dimensional virtual plane in which the viewpoint display 
icon was shifted to the end point of the drag operation 
and a three-dimensional virtual space viewed from the 
shifted view point (refer to steps S3 and S4). 

10 

(4) VIEWING ANGLE SHIFT OPERATION 

[0054] When the user performs a drag operation on 
the viewing angle icon 5 of the viewpoint display icon 
*s displayed on the city map in the two-dimensional virtual 
plane with a finger (one in step Sa1 and the object of 
search is a viewing angle icon in step Sa2), the opera- 
tion detecting element 2 detects the distance, the direc- 
tion, and the turning angle from the starting point to the 
end point of the drag operation, and outputs them to the 
information control section 3. The information control 
section 3 turns the viewing angle icon 5 to the end point 
of the drag operation on the basis of the distance and 
the direction from the starting point to the end point, gen- 
erates viewing angle information for turning the view- 
point in the three-dimensional virtual space by the de- 
tected turning angle, and outputs it to the display 1 . The 
display 1 displays a two-dimensional virtual plane in 
which the viewing angle icon 5 was turned to the end 
point of the drag operation and a three-dimensional vir- 
tual space viewed from the turned viewpoint (refer to 
steps S5 and S6). 

(5) SCALING OPERATION 

[0055] When the user performs a touch operation on 
the city map in the two-dimensional virtual plane with 
two fingers (two in step Sa1), the operation detecting 
element 2 detects the distance between the two fingers 
in time sequence and outputs it to the information control 
section 3. The information control section 3 generates 
scale information for displaying a reduced map in re- 
sponse to the fact that the distance between the two fin- 
gers is reduced when the two fingers come close to each 
other (when the distance was reduced in step Sa4), and 
outputs it to the display 1 . The information control sec- 
tion 3 also generates scale information for displaying an 
enlarged map in response to the fact that the distance 
between the two fingers is increased when the two fin- 
gers are separated from each other (when the distance 
was increased in step Sa4), and outputs it to the display 
1. The display 1 displays a three-dimensional virtual 
space and a two-dimensional virtual plane which were 
reduced or enlarged on the basis of the scale informa- 
tion outputted from the information control section 3 (re- 
fer to steps S7 and S8). 

[0056] The case in which the touch operation or the 
drag operation is performed in the three-dimensional vir- 
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tual space will be described with reference to the flow- 
chart of the process in the information control section 3 
of Fig. 4. 

(6) VIEWPOINT DIRECTION SHIFT OPERATION BY 
TOUCH OPERATION 

[0057] When the user performs a touch operation on 
a stereoscopic city map in the three-dimensional virtual 
space with a finger (one in step Sb1 and a touch oper- 
ation in step Sb2 of Fig. 4), the operation detecting ele- 
ment 2 detects the touch position and outputs it to the 
information control section 3. The information control 
section 3 generates viewpoint direction information for 
changing the rolling angle, the heading angle, and the 
pitch angle for specifying the viewpoint direction to 
change the viewpoint direction to the touch position and 
viewpoint shift information for turning the viewing angle 
icon 5, and outputs them to the display 1 . The display 1 
displays a three-dimensional virtual space in which the 
viewpoint direction is changed to the touch position in 
the stereoscopic city map in the three-dimensional vir- 
tual space on the basis of the viewpoint direction infor- 
mation outputted from the information control section 3 
(refer to step S9). The display 1 also displays a two- 
dimensional virtual plane in which the viewing angle icon 
5 is turned on the basis of the viewpoint shift information 
for turning the viewing angle icon 5(refer to step S10). 

(7) VIEWPOINT DIRECTION SHIFT OPERATION BY 
DRAG OPERATION 

[0058] When the user performs a drag operation on 
the stereoscopic city map in the three-dimensional vir- 
tual space with a finger (one in step Sb1 and a drag op- 
eration in step Sb2 of Fig. 4), the operation detecting 
element 2 detects the distance and the direction from 
the starting point to the end point of the drag operation 
and outputs them to the information control section 3. 
The information control section 3 generates viewpoint 
direction information for changing the rolling angle, the 
heading angle, and the pitch angle which specify the 
viewpoint direction to change the viewpoint direction by 
a distance from the starting point to the end point of the 
drag operation in the direction from the starting point to 
the end point of the drag operation, on the basis of the 
detection of the distance and the direction from the start- 
ing point to the end point of the drag operation, and out- 
puts it to the display 1 . The display 1 displays a three- 
dimensional virtual space in which the viewpoint direc- 
tion was changed by the distance from the starting point 
to the end point of the drag operation in the direction 
from the starting point to the end point of the drag oper- 
ation in the stereoscopic city map in the three-dimen- 
sional virtual space, on the basis of the viewpoint direc- 
tion information outputted from the information control 
section 3 (refer to step S11 ). The display 1 also displays 
a two-dimensional virtual plane in which the viewing an- 



gle icon 5 is turned on the basis of the viewpoint shift 
information for turning the viewing angle icon 5 (refer to 
step S12). 

5 (8) VIEWPOINT SHIFT OPERATION TOWARD THE 
RIGHT FRONT, LEFT FRONT, RIGHT REAR, AND 
LEFT REAR 

[0059] When the user performs a touch operation on 
the stereoscopic city map in the three-dimensional vir- 
tual space with two fingers (two in step Sb1 of Fig. 4), 
the operation detecting element 2 detects the distance 
and the direction from the first touch position, at which 
the touch operation was performed first, to the second 
touch position, at which the touch operation was per- 
formed next, in time sequence, and outputs them to the 
information control section 3. The information control 
section 3 determines the position of the midpoint be- 
tween the first touch position and the second position 
on the basis of the first touch position and the second 
position. The information control section 3 then gener- 
ates viewpoint shift information including the speed or 
the acceleration at which the viewpoint is to be shifted 
from the first touch position toward the midpoint on the 
basis of the distance and the direction from the first 
touch position to the midpoint and outputs it to the dis- 
play 1. / 
[0060] For example, when the second touch position 
is at the upper right, seen from the first touch position 
(right in step Sb3 and upper in step Sb4), the information 
control section 3 generates viewpoint shift information 
for shifting the viewpoint ahead on the right and outputs 
it to the display 1 . When the second touch position is at 
the lower right, seen from the first touch position (right 
in step Sb3 and lower in step Sb4), the information con- 
trol section 3 generates viewpoint shift information for 
shifting the viewpoint toward the left rear and outputs it 
to the display 1 . When the second touch position is at 
the upper right or, alternatively, at the lower left, seen 
from the first touch position, the information control sec- 
tion 3 also generates viewpoint shift information in ac- 
cordance with the above-described processing proce- 
dure and outputs it to the display 1 . 
[0061] The information control section 3 also deter- 
mines the position of a split point at which the line con- 
necting the first touch position and the second touch po- 
sition is split in a designated proportion, and when the 
split position is moved, the information control section 3 
generates viewpoint shift information including the 
speed or acceleration at which the viewpoint is to be 
shifted, on the basis of the shifted distance and shift di- 
rection of the split point and outputs it to the display 1 . 
[0062] For example, when the position of the split 
point is moved upward in time sequence, the information 
control section 3 generates viewpoint shift information 
for increasing the speed or acceleration at which the 
viewpoint is to be shifted, on the basis of the shifted dis- 
tance of the midpoint and outputs it to the display 1 . 
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[0063] When the position of the split point is moved 
downward in time sequence, the information control 
section 3 generates viewpoint shift information for de- 
creasing the speed or acceleration at which the view- 
point is to be shifted, on the basis of the shifted distance 
of the midpoint and outputs it to the display 1 . 
[0064] The split point may be an internal dividing point 
at which the line connecting the first touch position and 
the second position is divided internally in a designated 
proportion or, alternatively, may be an external dividing 
point at which the line connecting the first touch position 
and the second position is divided externally in a desig- 
nated proportion. 

[0065] The display 1 displays a three-dimensional vir- 
tual space seen from a viewpoint shifted in time se- 
quence and a two-dimensional virtual plane in which the 
viewpoint display icon is shifted in time sequence, on 
the basis of the viewpoint shift information outputted 
from the information control section 3 (steps S13 to 
S20). 

(9) VERTICALLY UPWARD AND DOWNWARD 
VIEWPOINT SHIFT OPERATION 

[0066] When the user performs a touch operation on 
the stereoscopic city map in the three-dimensional vir- 
tual space with three or more n fingers (three in step 
Sb1 ), the operation detecting element 2 detects the po- 
sition of the center of the first to n th touch positions in 
time sequence and outputs it to the information control 
section 3. The information control section 3 generates 
viewpoint shift information for shifting the viewpoint ver- 
tically on the basis of the time-series changes of the cen- 
tral position of the first to n" 1 touch positions and outputs 
it to the display 1 . For example, when the central point 
of the first to n** 1 touch positions is shifted vertically up- 
ward after the touch operation, the information control 
section 3 generates viewpoint shift information for shift- 
ing the viewpoint position vertically upward and outputs 
it to the display 1 . Alternatively, when the central point 
of the first to n m touch positions is shifted vertically 
downward after the touch operation, the information 
control section 3 generates viewpoint shift information 
for shifting the viewpoint position vertically downward 
and outputs it to the display 1 . The display 1 displays a 
three-dimensional virtual space, which is seen from a 
viewpoint shifted vertically upward or vertically down- 
ward, on the basis of the viewpoint shift information out- 
putted from the information control section 3 (steps S21 
to S22). 

[0067] As described above, a viewpoint shift opera- 
tion, a viewpoint direction shift operation, a forward or 
backward shift operation, an upward or downward shift 
operation, a rightward or leftward turning operation, and 
a scaling operation can be performed in the two-dimen- 
sional virtual plane or the three-dimensional virtual 
space with one, two, or three or more fingers in a manner 
close to that in a real space, thus allowing the user to 



feel a sense of unity with a virtual space shift operation. 
[0068] An example will then be described in which the 
virtual-space shift control apparatus according to the 
embodiment of the present invention is applied to a real- 

s estate brokerage system. Fig. 5 is a diagram of an op- 
eration screen for searching a building (factory, bank, 
building, publicand municipal offices, school, hotel, hos- 
pital, building built over a railroad station, amusement 
facilities, department store, station, high-rise collective 

10 housing, etc. in the neighborhood. When the user se- 
lects a target building, with an object selection button in 
Fig. 5, only the target building is displayed with the color 
changed to a color distinguishable from other buildings, 
on the map in the two-dimensional virtual plane and the 

15 stereoscopic map in the stereoscopic map in the three- 
dimensional virtual space. Also, Fig. 5 displays a route 
when a man/woman travels from the present location to 
the object. Therefore, the user can get a sense of the 
distance and the direction to the target building. 

20 [0069] Fig. 5 also displays three hemispherical oper- 
ation icons to which operations similar to the above-de- 
scribed operations are allocated in response to the 
number of operating fingers, wherein an operation icon 
6 is provided for one-finger operation, an operation icon 

25 7 is provided for two-finger operation, and an operation 
icon 8 is provided for three-finger operation. The oper- 
ation icons 6 to 8 have drag sections 6a, 7a, and 8a, 
respectively, at the center of each hemisphere. When 
the user performs a drag operation with the drag section 

30 of the operation icon, the operation detecting element 2 
detects the distance and the direction from the starting 
point to the end point of the drag operation in time se- 
quence and outputs them to the information control sec- 
tion 3. The information control section 3 generates view- 

35 point shift information for shifting the viewpoint on the 
basis of the time-series changes of the distance and the 
direction from the starting point to the end point of the 
drag operation and outputs it to the display 1 . The dis- 
play 1 displays a virtual space image on the basis of the 

40 viewpoint shift information outputted from the informa- 
tion control section 3. 

[0070] This solves a problem in that when a touch op- 
eration or a drag operation is made with a pointing de- 
vice of a certain width, such as a finger, the displayed 

45 part that is the object of the touch operation or the drag 
operation cannot be seen. In other words, the operation 
icon allows the execution of the series of virtual space 
shift control processes of the embodiment in a region 
near the display screen but does not overlap therewith. 

so [0071 ] Fig. 6 is a diagram of an example of the image 
of the external appearance of a condominium in which 
the virtual-space shift control apparatus is used for a re- 
al-estate brokerage system. The appearance of the CG 
(computer graphic) high-rise condominium displayed in 

55 a three-dimensional virtual space can be seen from var- 
ious viewpoints by upward or downward viewpoint shift 
operation and right-handed or left-handed viewpoint 
turning operation in the embodiment. 
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[0072] Fig. 7 is a diagram showing the appearance of 
room No. 1 ,806 on the 1 8 th floor of the condominium of 
Fig. 6. By selecting a target floor and room with a floor 
display icon of Fig. 6, viewpoint information is generated 
so as to shift the viewpoint to the window of the target 
room, so that the view from the target window can be 
enjoyed in the virtual space. 

[0073] Fig. 8 is a diagram showing the interior of the 
room of the condominium of Fig. 7, in which the layout 
drawing of the room is displayed in a two-dimensional 
virtual plane; and the stereoscopic view of the room 
seen from the position of the viewpoint display icon 
which is displayed on the layout drawing of the room is 
displayed in a three-dimensional virtual space. The vir- 
tual space control apparatus can also be applied to such 
a room space, wherein a viewpoint shift operation, a 
viewpoint direction shift operation, a forward or back- 
ward shift operation, an upward or downward shift op- 
eration, a rightward or leftward turning operation, and a 
scaling operation can be performed in the two-dimen- 
sional virtual plane or the three-dimensional virtual 
space with one, two, or three or more fingers in a manner 
close to that in a real space, thus allowing the user to 
perform various virtual space shift operations by a sim- 
ple operation with a finger or the like. 
[0074] The virtual-space shift control apparatus has 
therein a computer system. The series of processes of 
the virtual space shift control are stored in a recording 
medium which can be read by a computer in the form of 
a program. By reading and executing the program by 
the computer, the above-described processes are per- 
formed. The computer readable recording medium re- 
fers to a magnetic disc, a magneto-optical disc, a 
CD-ROM, a DVD-ROM, a semiconductor memory and 
so on. It is also possible that the computer program is 
distributed to a computer over a communication line and 
the computer that has received the distribution executes 
the program. 

[0075] According to the present invention, as de- 
scribed above, the virtual-space shift control system for 
shifting a virtual space image displayed on a display 
screen includes detecting a touch operation or a drag 
operation of a pointing device having a plurality of point- 
ing elements, which is performed on the display screen; 
generating viewpoint position information of the virtual 
space image on the basis of the detection of the detect- 
ing element; and generating a three-dimensional image 
for generating data on virtual space image seen from a 
viewpoint indicated by viewpoint position information 
and outputting it to the display. This thus provides the 
advantage that the user can perform various virtual 
space shift operations by a simple operation with a fin- 
ger or the like. 

[0076] According to the invention, in the virtual-space 
shift control system for shifting a virtual space image dis- 
played on a display screen, the operation detecting el- 
ement detects the number of pointing elements and the 
respective touch positions of the plurality of pointing el- 



ements, the pointing elements performing a touch oper- 
ation or a drag operation on a prescribed display area 
on which a virtual space image is displayed; the infor- 
mation control section generates viewpoint shift infor- 
s mation for shifting the viewpoint on the virtual space im- 
age on the basis of the number of the pointing elements 
and the respective touch positions of the pointing ele- 
ments and outputs it to the display; and the display dis- 
plays the virtual space on the basis of the shift informa- 
tion outputted from the information control section. This 
thus provides the advantages of allowing the allocation 
of various virtual space shift operations on the basis of 
the number of the pointing elements and the respective 
touch positions of the pointing elements, and allows the 
user to perform various virtual space shift operations by 
a simple operation with a finger or the like. 
[0077] According to the invention, the display displays 
an operation icon for operating the viewpoint in the vir- 
tual space; and the information control section receives 
time-series data on the distance and the direction from 
the starting point to the end point at which a drag section 
of the operation icon is dragged and generates view- 
point shift information for shifting the viewpoint on the 
basis of the time-series changes of the distance and the 
direction from the starting point to the end point. This 
thus provides the advantage that the display part does 
not go out of sight, owing to the touch operation and the 
drag operation. 



Claims 

1 . A virtual-space shift control apparatus comprising: 

a detecting element that detects a touch oper- 
ation or a drag operation of a pointing device 
having a plurality of pointing elements, per- 
formed on a display screen; 
a viewpoint-position information generator that 
generates viewpoint position information of a 
virtual space image based on the detected 
touch or drag operation of the detecting ele- 
ment; and 

a three-dimensional image generator that gen- 
erates data on the virtual space image seen 
from a viewpoint indicated by the viewpoint po- 
sition information and outputting a three dimen- 
sional image to the display. 

2. A virtual-space shift control apparatus, comprising: 

an operation detecting element that detects a 
plurality of pointing elements of a pointing de- 
vice and respective touch positions of the plu- 
rality of pointing elements, the pointing device 
performing a touch operation or a drag opera- 
tion on a prescribed display area on which a 
virtual space image is displayed; 
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an information control section that generates 
viewpoint shift information for shifting a view- 
point of the virtual space image based on the 
plurality of pointing elements and the respec- 
tive touch positions of the plurality of pointing 
elements and outputting viewpoint shift infor- 
mation to be displayed; and 
a display that displays the virtual space image 
based on the viewpoint shift information output- 
ted from the information control section. 

3. The virtual-space shift control apparatus according 
to claim 2, wherein the information control section 
generates the viewpoint shift information for shifting 
a position of the viewpoint to the touch position 
based on a position of the touch operation by one 
of the plurality of pointing elements. 

4. The virtual-space shift control apparatus according 
to claim 2, wherein the information control section 
receives time-series data of a distance and a direc- 
tion from a starting point to an end point of the drag 
operation by one of the plurality of pointing ele- 
ments and generates the viewpoint shift information 
for shifting the viewpoint based on the time-series 
data of the distance and the direction from the start- 
ing point toward the end point. 

5. The virtual-space shift control apparatus according 
to claim 2, wherein 

the display displays a virtual plane formed of 
a two-dimensional virtual image and a virtual space 
formed of a three-dimensional virtual image simul- 
taneously; and 

a viewpoint icon for the virtual space, which is 
displayed in the virtual plane, receives time-series 
data of a distance and a direction from a starting 
point to an end point of the drag operation by one 
of the plurality of pointing elements, and the infor- 
mation control section generates the viewpoint shift 
information for shifting the viewpoint in the virtual 
space based on the time-series data of the distance 
and the direction from the starting point to the end 
point of the drag operation. 

6. The virtual-space shift control apparatus according 
to claim 2, wherein 

the display displays a virtual plane formed of 
a two-dimensional virtual image and a virtual space 
formed of a three-dimensional virtual image simul- 
taneously; and 

a viewing angle icon for the viewpoint in the 
virtual space, which is displayed in the virtual plane, 
receives data of a turning angle of the drag opera- 
tion by one of the plurality of pointing elements, and 
the information control section generates the view- 
point shift information for turning the viewing angle 
icon by the turning angle. 



7. The virtual-space shift control apparatus according 
to claim 2, wherein the information control section 
receives data of a distance and a direction from a 
first touch position of an initial touch operation to a 

5 second touch position of a next touch operation, 
and generates viewpoint shift information for shift- 
ing the viewpoint based on the distance and the di- 
rection from the first touch position to the second 
touch position. 

8. The virtual-space shift control apparatus according 
to claim 7, wherein the information control section 
determines a position of a split point at which a line 
connecting the first touch position and the second 

is touch position in a designated proportion based on 
the first touch position and the second touch posi- 
tion, and generates the viewpoint shift information 
for changing a speed or an acceleration at which 
the viewpoint is shifted, based on time-series 

20 changes of the position of the split point. 

9. The virtual-space shift control apparatus according 
to claim 2, wherein 

the display displays a virtual plane formed of 
25 a two-dimensional virtual image and a virtual space 
formed of a three-dimensional virtual image simul- 
taneously; and 

the information control section receives time- 
series data of a distance between touch positions 
30 by two of the plurality of pointing elements, and gen- 
erates scale information for enlarging or reducing 
the virtual plane based on time-series changes of 
the distance between the touch positions by the two 
pointing elements. 

35 

10. The virtual-space shift control apparatus according 
to claim 2, wherein the information control section 
receives time-series data on a position of a central 
point of first to n th touch positions, and generates 

40 the viewpoint shift information for shifting the view- 
point based on the time-series changes of the po- 
sition of the central point of the first to n* touch po- 
sitions. 

45 11. The virtual-space shift control apparatus according 
to claim 2, wherein 

the display displays an operation icon for op- 
erating the viewpoint in the virtual space; and 

the information control section receives time- 
50 series data of a distance and a direction from a start- 
ing point to an end point of the drag operation of a 
drag section of the operation icon, and generates 
viewpoint shift information for shifting the viewpoint 
... based on time-series changes of the distance and 
55 the direction from the starting point to the end point. 

12. A virtual-space shift control method comprising: 
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detecting a touch operation or a drag operation 
of a pointing device having a plurality of point- 
ing elements, which is performed on a display 
screen; 

generating viewpoint position information of a 
virtual space image based on the detected 
touch or drag operation; and 
generating a three-dimensional image for gen- 
erating data on the virtual space image seen 
from a viewpoint indicated by the viewpoint po- 
sition information and outputting it to the dis- 
play. 

13. A virtual-space shift control method comprising: 

detecting a plurality of pointing elements of a 
pointing device and respective touch positions 
of the plurality of pointing elements, the point- 
ing device performing a touch operation or a 
drag operation on a prescribed display area on 
which a virtual space image is displayed; 
generating viewpoint shift information for shift- 
ing a viewpoint on the virtual space image 
based on the plurality of pointing elements and 
the respective touch positions of the pointing 
elements, and outputting the shifted virtual 
space image to the display; and 
displaying the virtual space image based on the 
viewpoint shift information. 

14. The virtual-space shift control method according to 
claim 13, further comprising generating the view- 
point shift information for shifting a position of the 
viewpoint to a touch position, based on a position 
of the touch operation by one of the plurality of point- 
ing elements. 

15. The virtual-space shift control method according to 
claim 13, further comprising receiving time-series 
data on a distance and a direction from a starting 
point to an end point of the drag operation by one 
of the plurality of pointing elements, and generating 
the viewpoint shift information for shifting the view- 
point in the virtual space image based on the time- 
series data on the distance and the direction from 
the starting point to the end point. 

16. The virtual-space shift control method according to 
claim 13, further comprising: 



one of the plurality of pointing elements; and 
generating the viewpoint shift information for 
shifting the viewpoint in the virtual space based 
on the time-series data on the distance and the 
5 direction from the starting point to the end point 

of the drag operation. 

17. The virtual-space shift control method according to 
claim 13, further comprising: 

10 

displaying a virtual plane formed of a two-di- 
mensional virtual image and a virtual space 
formed of a three-dimensional virtual image si- 
multaneously; and 

displaying in the virtual plane, a viewing angle 
icon for the viewpoint in the virtual space: 

receiving data on a turning angle of the 
drag operation by one of the plurality of 
20 pointing elements, and generating the 

viewpoint shift information for turning a 
viewing angle by the turning angle. 

18. The virtual-space shift control method according to 
25 claim 13, further comprising: 

receiving data on a distance and a direction 
from a first touch position of an initial touch op- 
eration to a second touch position of a next 
30 touch operation; and generating the viewpoint 

shift information for shifting the viewpoint 
based on the distance and the direction from 
the first touch position to the second touch po- 
sition. 

35 

19. The virtual-space shift control method according to 
claim 18, further comprising: 

determining a position of a split point at which 
40 aline connecting the first touch position and the 

second touch position is split in a designated 
proportion based on the first touch position and 
the second touch position; and generating the 
viewpoint shift information for changing a 
45 speed or an acceleration at which the viewpoint 

is shifted, based on time-series changes of the 
position of the split point. 

20. The virtual-space shift control method according to 
so claim 13, further comprising: 

displaying a virtual plane formed of a two-di- 
mensional virtual image and a virtual space 
formed of a three-dimensional virtual image at 
the same time; 

receiving time-series data on a distance be- 
tween the touch positions by two of the plurality 
of pointing elements; and 



displaying a virtual plane formed of a two-di- 
mensional virtual image and a virtual space 
formed of a three-dimensional virtual image si- 
multaneously; and 

displaying a viewpoint icon for the virtual space 55 
in the virtual plane that receives time-series da- 
ta on a distance and a direction from a starting 
point to an end point of the drag operation by 
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generating scale information for enlarging or re- 
ducing the virtual plane based on time-series 
data on the distance between the touch posi- 
tions by the two pointing parts. 

21 . The virtual-space shift control method according to 
claim 13, further comprising: 

receiving time-series data on a position of a 
central point of first to n" 1 touch positions; and 
generating viewpoint shift information for shift- 
ing the viewpoint based on time- series chang- 
es of the position of the central point of the first 
to n ,h touch positions. 

22. The virtual-space shift control method according to 
claim 13, wherein further comprising: 

displaying an operation icon for operating the 
viewpoint in the virtual space image; 
receiving time-series data on a distance and a 
direction from a starting point to an end point of 
the drag operation of a drag section of the op- 
eration icon; and generating viewpoint shift in- 
formation for shifting the viewpoint based on 
the time-series changes of the distance and the 
direction from the starting point to the end point. 

23. A program used in a virtual-space shift control ap- 
paratus comprising: 

a detecting element that detects a touch oper- 
ation or a drag operation of a pointing device 
having a plurality of pointing elements, per- 
formed on a display screen; 
a viewpoint-position information generator that 
generates viewpoint position information of a 
virtual space image based on the detected 
touch or drag operation of the detecting ele- 
ment; and 

a three-dimensional image generator that gen- 
erates data on the virtual space image seen 
from a viewpoint indicated by the viewpoint po- 
sition information and outputting a three dimen- 
sional image to the display. 

24. A program for executing a virtual-space shift control 
apparatus comprising: 

an operation detecting element that detects a 
plurality of pointing elements of a pointing de- 
vice and respective touch positions of the plu- 
rality of pointing elements, the pointing device 
performing a touch operation or a drag opera- 
tion on a prescribed display area on which a 
virtual space image is displayed; 
an information control section that generates 
viewpoint shift information for shifting a view- 



point of the virtual space image based on the 
plurality of pointing elements and the respec- 
tive touch positions of the plurality of pointing 
elements, and outputting the virtual space im- 
5 age to be displayed; and 

a display that displays the virtual space image 
based on the viewpoint shift information output- 
ted from the information control section. 

10 25. A recording medium in which a program used for 
executing a virtual-space shift control apparatus 
comprising: 

a detecting element that detects a touch oper- 
as ation or a drag operation of a pointing device 
having a plurality of pointing elements, per- 
formed on a display screen; 
a viewpoint-position information generator that 
generates viewpoint position information of a 
20 virtual space image based on the detected 
touch or drag operation of the detecting ele- 
ment; and 

a three-dimensional image generator that gen- 
erates data on the virtual space image seen 
25 from a viewpoint indicated by the viewpoint po- 

sition information and outputting a three dimen- 
sional image to the display. 

26. A recording medium in which a program for execut- 
30 ing a virtual-space shift control apparatus is record- 
ed, the apparatus comprising: 



an operation detecting element that detects a 
plurality of pointing elements of a pointing de- 

35 vice and respective touch positions of the plu- 

rality of pointing elements, the pointing device 
performing a touch operation or a drag opera- 
tion on a prescribed display area on which a 
virtual space image is displayed; 

40 an information control section that generates 

viewpoint shift information for shifting a view- 
point of the virtual space image based on the 
plurality of pointing elements and the respec- 
tive touch positions of the plurality of pointing 

45 elements and outputting the virtual space im- 

age to be displayed; and 
a display that displays the virtual space image 
based on the viewpoint shift information output- 
ted from the information control section. 

50 
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